Coupled Transductive Ensemble Learning of Kernel Models
نویسندگان
چکیده
In this paper we propose the concept of coupling for ensemble learning. In the existing literature, all submodels that are considered within an ensemble are trained independently from each other. Here we study the effect of coupling the individual training processes within an ensemble of regularization networks. The considered coupling set gives the opportunity to work with a transductive set for both regression and classification problems. We discuss links between this coupled learning and multitask learning and explain how it can be interpreted as a form of group regularization. The methods are illustrated with experiments on classification and regression data sets.
منابع مشابه
Ensemble Learning of Coupled Parameterized Kernel Models
In this paper we propose a new method for learning a combination of estimators. Classically, committee networks are constructed after training the networks independently from each other. Here we present a learning strategy where the training is done in a coupled way. We illustrate that combining parameterized kernel methods with output coupling and use of a synchronization set of data points le...
متن کاملEnsemble Kernel Learning Model for Prediction of Time Series Based on the Support Vector Regression and Meta Heuristic Search
In this paper, a method for predicting time series is presented. Time series prediction is a process which predicted future system values based on information obtained from past and present data points. Time series prediction models are widely used in various fields of engineering, economics, etc. The main purpose of using different models for time series prediction is to make the forecast with...
متن کاملTransductive Kernel Matrix Learningwith Hierarchic Bayesian Model, Application to Hyperspectral Images
In recent years, kernel methods have demonstrated their performance in hyperspectral imaging. Among the reasons their ability to handle large input spaces is essential. However for this type of applications a critical problem is the choice of the kernel which must combine spectral and spatial information [1] and of course achieve good generalization performance. The kernel design stage is gener...
متن کاملTransductive Inference & Kernel Design for Object Class Segmentation
Transductive inference techniques are nowadays becoming standard in machine learning due to their relative success in solving many real-world applications. Among them, kernel-based methods are particularly interesting but their success remains highly dependent on the choice of kernels. The latter are usually handcrafted or designed in order to capture better similarity in training data. In this...
متن کاملTransductive Reliability Estimation for Kernel Based Classifiers
Estimating the reliability of individual classifications is very important in several applications such as medical diagnosis. Recently, the transductive approach to reliability estimation has been proved to be very efficient when used with several machine learning classifiers, such as Naive Bayes and decision trees. However, the efficiency of the transductive approach for state-of-the art kerne...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2003